Overview of the NTCIR-13 OpenLiveQ Task
نویسندگان
چکیده
This is an overview of the NTCIR-13 OpenLiveQ task. This task aims to provide an open live test environment of Yahoo Japan Corporation’s community question-answering service (Yahoo! Chiebukuro) for question retrieval systems. The task was simply defined as follows: given a query and a set of questions with their answers, return a ranked list of questions. Submitted runs were evaluated both offline and online. In the online evaluation, we employed optimized multileaving, a multileaving method that showed high efficiency over the other methods in our preliminary experiment. We describe the details of the task, data, and evaluation methods, and then report official results at NTCIR-13 OpenLiveQ.
منابع مشابه
TUA1 at the NTCIR-13 OpenLiveQ Task
Our group submitted the OpenLiveQ task of NTCIR-13. With th openliveq tool offered from the organizers, we compare a baseline result with three results ranked by RF (Random Forests). It shows the result ranked by RF in 1000 bags is closest to baseline, but still lower in average.
متن کاملErler at the NTCIR-13 OpenLiveQ Task
In this paper, we present our approach to address the OpenLiveQ task at NTCIR-13 [5]. The task is a question retrieval task and can be simply defined as follows: given a query and a set of questions with their answers, return a ranked list of questions. However, there is a “gap” between queries and candidate questions, which is called lexical chasm or word mismatch problem. In our model, we imp...
متن کاملYJRS at the NTCIR-13 OpenLiveQ Task
We participated in the NTCIR-13 OpenLiveQ Task in view of improving the baseline method, which is a linear combination of 77 features with different weights. We added three settings of extended BM25F as additional features, replaced the target function of weight optimization and recalculated feature weights using 5-fold cross validation. Our run achieved the best Q-measure score among 10 runs i...
متن کاملOverview of NTCIR-12
This is an overview of NTCIR-13, the thirteenth sesquiannual research project for evaluating information access technologies. NTCIR-13 presents a diverse set of evaluation tasks related to information retrieval, question answering, natural language processing, etc (in total, nine tasks have been organized at NTCIR-13). This paper describes an outline of the research project, which includes its ...
متن کاملOverview of NTCIR-13 NAILS Task
In this paper we review the NTCIR-13 NAILS (Neurally Augmented Image Labelling Strategies) pilot task at NTCIR13. We describe a first-of-its-kind RSVP (Rapid Serial Visual Presentation) EEG (Electroencephalography) dataset released as part of the NTCIR-13 participation conference and the results of the participating organisations who benchmarked machine-learning strategies against each other us...
متن کامل